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Background/Aims: Spontaneous reporting systems have several weak points, such as low reporting rates and 
insufficient clinical information. Active surveillance programs, such as ward rounds and a clinical data repository (CDR), 
may supplement the weak points of such systems. We developed active surveillance programs and compared them 
with existing spontaneous reporting. 

Methods: We collected adverse drug event (ADE) cases, which comprised 1,055 cases of spontaneous reporting, 309 
reported by ward rounds, and 229 found using a CDR. The clinical features and causative drugs were evaluated. 
Results: Active surveillance programs detected additional serious ADEs compared to those of spontaneous reporting 
programs. The ADEs identified by CDR (22.9%) were more likely to be classified as "serious" than those reported 
spontaneously (5.2%) or identified during ward rounds (10.3%). Causative drugs also differed. Opioids, antibiotics, 
and contrast media were the most common drugs causing ADEs in the spontaneous reporting system, whereas the 
active surveillance programs identified antibiotics as the most common causative drug. Clinical features also differed. 
ADEs with gastrointestinal manifestations were reported most frequently by spontaneous reporting programs. ADEs 
reported from active surveillance more reliably identified events associated with changes in laboratory values, such 
as hepatobiliary toxicity, hematologic manifestations, and nephrologic manifestations, compared with spontaneous 
reporting programs. 

Conclusions: Our findings suggest that active surveillance programs can supplement spontaneous reporting systems 
in hospitals. ADEs related to laboratory abnormalities were monitored more closely by active surveillance programs and 
may be useful for identification of serious ADEs. 
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INTRODUCTION 

Adverse drug events (ADEs) are the most common 
safety-concerning events occurring in hospitals [1-3]. 



ADEs occur in 2.4 to 5.2/100 adult hospitalized patients 
[4-7], increasing both the length of hospital stays by 2.2 
days and hospital costs by $1,900 to $5,900 [4,8]. Re- 
cent studies have shown that 44% to 78% of ADEs may 
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be due to systemic problems that could be corrected by 
an adequate information system [9,10]. 

Two different methods of collecting ADE reports are 
available [11]. One is traditional ADE reporting, which 
is called "spontaneous reporting." The other is "active 
surveillance," using a phone-structured interview [12], 
ward rounds and chart review [13,14] or computer mon- 
itoring [15-17]. Traditional, spontaneous reporting sys- 
tems have long been the primary mechanism by which 
institutions identify ADEs [14,18-21], but they have 
proven ineffective due to under-reporting. Spontaneous 
reporting identifies at most only 5% of all ADEs [22]. 
Besides under-reporting problems, clinical information 
from spontaneously reported ADEs sometimes lacks 
essential data, such as a lack of temporal relationship, 
responses to challenges and/or re-challenge, and under- 
lying patient condition, each of which are essential for 
identification of the causality of suspected drugs. 

Various active surveillance programs are used for 
pharmacovigilance in hospitals. 'Ward rounds and chart 
review' examines ADEs documented in the chart [13,16]. 
Ward rounds and chart review is a prospective method 
that reveals detailed information about an ADE, but the 
burden of cost is substantial, and it requires training 
chart reviewers as to the definitions of ADEs and which 
triggers to look for. Computer monitoring is also used 
to screen both administrative and clinical databases for 
ADEs, based on a set of rules [7,21]. When a suspected 
event is flagged by the system, a pharmacist or trained 
investigator performs a targeted chart review to verify 
the event. This is much less labor-intensive than a rou- 
tine chart review. Many hospitals, including ours, have 
recently replaced paper charts with electronic medical 
record (EMR) systems, permitting easy identification of 
suspected ADEs from the databases of either in- or out- 
patients. 

Severance Hospital recently developed an active 
surveillance pharmacovigilance program that involves 
ward rounds followed by chart review and the inpatient 
clinical database, in addition to a traditional spontane- 
ous reporting program. In this study, we retrospectively 
evaluated the performance of these active and sponta- 
neous reporting programs and found significant differ- 
ences in the clinical features of the ADEs collected by 
these programs. 



METHODS 

Study setting 

A total of 1,593 adverse drug reactions (ADRs) were 
collected from Severance Hospital, which is a 2,100-bed, 
tertiary-care general teaching hospital located in Seoul, 
from October 2009 to July 2010. The hospital has ad- 
opted an EMR system. This system was developed by 
LG CNS (Seoul, Korea) and contains comprehensive 
data, including patient demographic information, pre- 
scriptions, diagnostic codes, laboratory results, medica- 
tion profiles, vital signs, progress notes by doctors, and 
nursing notes. Three methods of collecting ADEs are 
used at Severance Hospital. A spontaneous reporting 
system relies on electronic reporting by nurses, phar- 
macists, and doctors. We educate and encourage these 
medical professionals to report any suspected ADEs. A 
second pharmacovigilance method uses ward rounds 
and a chart review by doctors, pharmacists, and spe- 
cialized nurses. Of the 68 wards in our hospital, we per- 
form ward rounds in only 30 due to limited resources. 
The inspectors ask nurses or residents at the wards for 
the suspected ADE cases, and the patient electronic 
records are then reviewed. The third method is an 
analysis of the clinical data repository (CDR). Since De- 
cember 2007, Severance Hospital has used the Clinical 
Data Research System (CDRS; LG CNS), an internally 
developed hospital information system that collects 
comprehensive data, including orders, diagnostic codes, 
patient demographic information, laboratory results, 
medication profiles, nursing notes, and vital signs. We 
identified ADEs using the CDRS at 2-week intervals 
beginning in April 2010. A trained reviewer performed 
a targeted review of each patient's electronic medical 
chart, which was then associated with a specific ADE. 
We monitored five terms, "drug," "adverse effect," "poi- 
soning," "intoxication," and "toxicity," listed in either the 
final diagnosis of the discharge summary or on consul- 
tation forms during admission. The EMR charts of sus- 
pected CDR cases were reviewed by a trained physician 
who then reported the cases to the pharmacovigilance 
system as hospital ADEs. All ADE reports from spon- 
taneous and active surveillance programs were verified 
by the ADR Monitoring Committee of Severance Hos- 
pital. The identified ADEs were characterized in terms 
of seriousness, causality, type, and associated clinical 
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manifestations. We used the World Health Organization 
(WHO) Adverse Reaction Terminology to report the 
ADRs. This terminology is hierarchical, and consists 
of four terms: a "systemic organ" term, broad "high- 
level" terms, a specific and disease-related or symptom- 
related "preferred" term, and the frequently reported 
alternative "included" term [23]. We assessed causality 
using criteria from the WHO Uppsala Monitoring Cen- 
ter (UMC), which consists of six levels of global intro- 
spection, as follows: certain, probable/likely, possible, 
unlikely, conditional/unclassified, and inaccessible/un- 
classifiable [24]. ADE severity was categorized as either 
serious or non-serious. The serious category included 
life -threatening events, death, permanent disabilities, 
congenital abnormalities, or prolonged hospitalization. 
ADRs were further classified by reaction type [24]. Type 
A reactions were usually dose-dependent, predictable, 
preventable, and of low mortality, whereas type B reac- 
tions were not dose-dependent but were idiosyncratic, 
unpreventable, and resulted in high mortality. Type C 
reactions were both dose- and time-related. 

Statistical analysis 

Descriptive statistics were used to assess the ADE 
cases. Results are reported as means and standard er- 
rors, except for demographic data. ADE rates among the 
ADE monitoring programs were compared using the 
chi-square test for goodness of fit. All calculations were 
performed using the SAS version 9.1.3 (SAS Institute, 
Cary, NC, USA). 



RESULTS 

Demographic features of the collected ADEs 

We collected 1,593 ADE cases. Of these, 1,055 (66.2%) 
were obtained by spontaneous reporting, 309 (19.4%) 
by ward rounds, and 229 (14.4%) by CDR. 

Median patient age was 51.3 years, and females 
(52.5%) predominated over males (47.5%). Causality 
assessments for spontaneously reported and active sur- 
veillance ADEs were not significantly different. Probable 
causality (56.3%) was the most common assessment, fol- 
lowed by possible (31.6%), certain causality (7.3%), un- 
likely (4.4%), conditional (0.3%), and inaccessible (0.1%) 
(Table 1). Nurses reported using spontaneous report- 
ing more frequently (73.8%) than did doctors (24.8%). 

Causative drugs of the ADE cases 

The causative drugs in this study are shown in Table 
2. Opioids (30.1%) were the most common causative 
drug in the spontaneous reporting program, followed 
by antibiotics (17.4%), contrast media (10.7%), and neu- 
ropsychiatric drugs (9.5%). Antibiotics (37.2%) were the 
most common causative drugs associated with active 
surveillance, followed by opioids (11.5%), anti-neoplastic 
agents (10.4%), and cardiovascular agents (7.3%). Ceph- 
alosporins (8.9%) were the most frequently identified 
antibiotics. 

Clinical manifestations of the ADEs 

The CDR identified serious ADEs more frequently 
than did the other methods. The CDR detected 52 se- 
rious ADEs of a total of 229 (22.7%), compared to 55 
serious ADEs of 1,055 reported spontaneously (5.2%), 
and 32 serious ADEs of 309 reported by ward rounds 



Table 1. Causality assessment using the WHO-Uppsala Monitoring Center criteria 




Spontaneous 




Active surveillance 


Total 


Variable 


reporting 
(n = 1,055) 


Ward rounds 
(n = 309) 


Clinical data repository 
(n = 229) 


(n = 1,593) 


Certain 


91 (8.6) 


22 (7.1) 


4(1.8) 


117(7.3) 


Probable 


612 (58.0) 


141 (45.6) 


144 (62.9) 


897 (56.3) 


Possible 


301 (28.5) 


128(41.4) 


75 (32.8) 


504 (31.6) 


Unlikely 


47 (4.5) 


17 (5.5) 


6 (2.6) 


70 (4.4) 


Conditional 


3 (0.3) 


1 (0.3) 


0 (0.0) 


4 (0.3) 


Inaccessible 


1 (0.1) 


0 (0.0) 


0 (0.0) 


1 (0.1) 



Values are presented as number (%). 
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Table 2. Drugs causing adverse drug events identified by three pharmacovigilance methods 



Spontaneous Active surveillance 



Drug 


reporting 
(n = 1,055) 


Ward rounds 
(n = 309) 


Clinical data repository 
(n = 229) 


Total 


p value 


Antimicrobials 


184 (17.4) 


84 (27.2) 


116(50.7) 


384 (24.1) 


< 0.001 


Penicillin 


26 (2.5) 


22 (7.1) 


23 (10.0) 


71 (4.5) 




Cephalosporin 


74 (7.0) 


29 (9.4) 


39 (17.0) 


142 (8.9) 




Quinolone 


24 (2.3) 


7(2.3) 


5 (2.2) 


36 (2.3) 




Macrolide 


4 (0.4) 


0 


0 


4 (0.3) 




Sulfa 


1 (0.1) 


0 


3(1.3) 


4 (0.3) 




Other antibiotics 


55 (5.2) 


26 (8.4) 


46 (20.1) 


127 (8.0) 




Anti-tuberculosis 


6 (0.6) 


2 (0.6) 


6 (2.6) 


140 (0.9) 


0.017 


Anti-fungals 


6 (0.6) 


2 (0.6) 


9 (3.9) 


17(1.1) 


< 0.001 


Anti-virals 


10(0.9) 


6(1.9) 


1 (0.4) 


17(1.1) 


0.264 


Neuropsychiatric drugs 


100 (9.5) 


19(6.1) 


13(5.7) 


132 (8.3) 


0.053 


Anti-depressant 


40 (3.8) 


5(1.6) 


1 (0.4) 


46 (2.9) 




Anti-psychotic 


11 (1.0) 


1 (0.3) 


2 (0.9) 


14 (0.9) 




Anti-convulsant 


35 (3.3) 


10(3.2) 


10(4.4) 


55 (3.5) 




Anti-Parkinsonian 


6 (0.6) 


3 (0.9) 


0 


9 (0.6) 




Anti-dementia 


8 (0.8) 


0 


0 


8 (0.5) 




NSAIDs 


40 (3.8) 


10 (3.2) 


7 (3.1) 


57 (3.6) 


0.809 


Conventional NSAID 


39 (3.7) 


8 (2.6) 


5(2.2) 


52 (3.3) 




Coxib 


1 (0.1) 


2 (0.6) 


2 (0.9) 


5 (0.3) 




Cardiovascular drugs 


26 (2.5) 


31 (10.0) 


8 (3.5) 


65 (4.1) 


< 0.001 


Respiratory drugs 


38 (3.6) 


4(1.3) 


1 (0.4) 


43 (2.7) 


0.007 


Anti-neoplastics 


12(1.1) 


31 (10.0) 


25 (10.9) 


68 (4.3) 


< 0.001 


Opioids 


318 (30.1) 


56 (18.1) 


6 (2.6) 


380 (23.9) 


< 0.001 


Gastrointestinal (Gl) drugs 


76 (7.2) 


12 (3.9) 


4(1.7) 


92 (5.8) 


0.002 


Anti-ulcer drugs 


11 (1.0) 


1 (0.3) 


2 (0.9) 


14 (0.9) 




Gl motility modulators 


65 (6.2) 


11 (3.6) 


2 (0.9) 


78 (4.9) 




Anti-thrombics 


10(0.9) 


10 (3.2) 


16 (7.0) 


36 (2.3) 


< 0.001 


Lipid-lowering agents 


14(1.3) 


0 


2 (0.9) 


16(1.0) 


0.090 


Muscle relaxants 


4 (0.4) 


3 (0.9) 


2 (0.9) 


9 (0.6) 


0.226 


Hormones 


7 (0.7) 


2 (0.6) 


1 (0.4) 


10(0.6) 


1.000 


Oral hypoglycemic 


4 (0.4) 


8 (2.6) 


0 


12 (0.8) 


0.001 


Anti-osteoporotics 


1 (0.1) 


0 


1 (0.4) 


2 (0.1) 


0.304 


Antihistamines 


7 (0.7) 


0 


0 


7 (0.4) 


0.359 


Steroids 


12(1.1) 


9 (2.9) 


0 


21 (1.3) 


0.009 


Vitamins 


17(1.6) 


0 


1 (0.4) 


18(1.1) 


0.024 


Immunosuppressants 


4 (0.4) 


2 (0.6) 


2 (0.9) 


8 (0.5) 


0.426 


Contrast medias 


113(10.7) 


4(1.3) 


4(1.7) 


121 (7.6) 


< 0.001 


Others 


46 (4.4) 


14 (4.5) 


4(1.7) 


64 (4.0) 


0.166 



Values are presented as number (%). 
NSAID, non-steroidal anti-inflammatory drug. 

(10.4%) (Fig. lA). Most ADRs identified by CDR were ously reported ADEs and 27.8% of those identified by 

type B reactions (69.9%), whereas 36.0% of spontane- ward rounds and chart review were classified as type B 
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(Fig. lB). Of the type B reactions identified by the CDR, 
24.6% were considered serious. Gastrointestinal in- 
volvement was the most frequent clinical manifestation 
identified by the spontaneous reporting program, oc- 
curring in 35.4%, followed by skin involvement (30.5%) 
and neurologic involvement (14.8%), including head- 
ache, dizziness, and insomnia (Table 3). The active sur- 



veillance program detected skin involvement frequently 
(30.1%). However, the active surveillance program also 
detected ADEs associated with laboratory abnormalities, 
such as hematologic manifestations (14.9% vs. 0.6%, p < 
0.001), hepatobiliary toxicity (5.2% vs. 0.6%, p < 0.001), 
and nephrotoxicity (9.9% vs. 0.3%, p < 0.001), more reli- 
ably than did either of the other systems (Fig. lC). 



© © © 




Spontaneous Ward rounding CDR Spontaneous Ward rounding CDR Spontaneous Ward rounding CDR 



Figure 1. (A) Percentages of serious adverse drug events (ADEs) identified by spontaneous reporting and two active surveillance 
programs. (B) Percentages of type B ADEs identified by spontaneous reporting and two active surveillance programs. (C) Percentages of 
ADEs associated with laboratory abnormalities identified by spontaneous reporting and two active surveillance programs. Laboratory 
abnormalities included hepatic, hematologic, and nephrotic ADEs. CDR, clinical data repository. a p < 0.01, b p < O.05. 



Table 3. Clinical manifestations of adverse drug events according to pharmacovigilance method 




Spontaneous 


Active surveillance 




Involved organs or systems 


reporting 


Ward rounds 


Clinical data repository 


p value 




(n = 1,055) 


(n = 309) 


(n = 229) 




Generalized reaction 


42 (4.0) 


7 (2.3) 


10 (4.4) 


0.316 


Skin 


322 (30.5) 


35 (11.3) 


127 (55.5) 


< 0.001 


Head, eyes, ears, nose, and throat 


26 (2.8) 


7 (2.3) 


8 (3.5) 


0.691 


Cardiovascular 


44 (4.2) 


13 (4.2) 


3(1.3) 


0.108 


Gastrointestinal 


373 (35.4) 


79 (25.6) 


11 (4.8) 


< 0.001 


Hepatobiliary 


6 (0.6) 


14 (4.5) 


14 (6.1) 


< 0.001 


Respiratory 


13(1.2) 


4(1.3) 


4(1.8) 


0.717 


Hematologic 


6 (0.6) 


67 (21.7) 


13 (5.7) 


< 0.001 


Nephrologic 


3 (0.3) 


24 (7.8) 


29 (12.7) 


< 0.001 


Neurologic 


156 (14.8) 


35 (11.3) 


6 (2.6) 


< 0.001 


Endocrine 


4 (0.4) 


14 (4.5) 


0 


< 0.001 


Musculoskeletal 


9 (0.9) 


1 (0.3) 


2 (0.9) 


0.682 


Anaphylaxis 


40 (3.5) 


3(1.0) 


0 


0.001 


Others 


11 (1.0) 


6 (1.9) 


2 (0.9) 


0.414 



Values are presented as number (%). 
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DISCUSSION 

Spontaneous reporting facilitates identification of 
possible ADEs and drug associations but has a number 
of limitations. Under-reporting is a common problem 
with spontaneous surveillance [25], and analysis of 
passive surveillance data does not yield an incidence 
rate. Thus, multidisciplinary programs are required to 
detect ADEs in a hospital [14]. Active surveillance can 
be defined as the periodic collection of case reports 
from healthcare data systems. Active surveillance sys- 
tems, such as ward rounds associated with chart review 
and the CDR, increase the rate of ADRs detection in a 
hospital setting. Most reporters using the spontaneous 
reporting program in this study were nurses. Motivat- 
ing doctors to report ADEs spontaneously is difficult 
[20], and nurse and pharmacist participation may be 
essential for successful implementation of a spontane- 
ous pharmacovigilance program in a hospital [14,26,27]. 
However, nurses and pharmacists may not be aware of 
all aspects of the ADEs occurring in a hospital, so addi- 
tional active programs may be needed. In this study, we 
found little overlap in the cases reported by the sponta- 
neous and active surveillance programs, which might 
reflect the different characteristics of the ADEs collect- 
ed. The most common cause of spontaneously reported 
ADEs was opioids. Monitoring pain control is an impor- 
tant duty of nurses, and patients frequently complain of 
gastrointestinal symptoms. This result may reflect the 
characteristics of the patients admitted to our hospital. 
In Korea, bipolarization of the use of medical services 
is becoming a serious problem. Patients who require 
anti-cancer chemotherapy, invasive medical treatment, 
or surgical intervention are becoming more favored in 
major general hospitals in Seoul, including ours. As a 
consequence, use of opioids is relatively more frequent 
than at other general hospitals in Korea. 

Antibiotics were the most common causative drugs 
identified by both ward rounds and the CDR, as has 
been reported previously. For example, Hunziker et al. 
[28] reported that the most common drugs causative 
of cutaneous drug reactions were penicillin antibiotics, 
cotrimoxazole, and non-steroidal anti-inflammatory 
drugs, using a computerized database between 1974 and 
1993. However, the proportions of ADRs due to quino- 
lone and vancomycin are high. The high frequency of 



ADRs due to vancomycin may be because to 75% of the 
data originated in the six general hospitals that care for 
the most serious patients, and the relatively high preva- 
lence of methicillin-resistant Staphylococcus aureus in 
Korea [29]. 

We found that the active surveillance program ef- 
fectively detected additional serious ADEs and those 
associated with laboratory abnormalities. A significant 
number of additional type B reactions were identi- 
fied by the CDR. This may have been attributable to 
the signals used for CDR monitoring, which include 
toxicity, poisoning, and intoxication; these might be 
associated with ADE seriousness or those related to 
laboratory anomalies. Serious ADEs constitute a major 
public health concern as causes of morbidity, mortality, 
and high medical expense, reinforcing the importance 
of implementation of active surveillance systems for 
patient safety in hospitals. Similar results have been 
reported previously [15,17]. Jha et al. [15] reported that 
active surveillance models, such as chart review and 
computer monitoring, detected more serious ADEs or 
those associated with laboratory values, such as renal 
failure or hypoglycemia, more effectively than did other 
methods. Although our and their results were similar, 
the monitoring rules were quite different. They used 
52 rules, which were modified from the LDS Hospital 
Study rules [30]; those can be classified into orders for 
known antidotes, laboratory abnormalities, and labora- 
tory abnormalities occurring in the presence of certain 
drugs. We used simple and intuitive rules, such as the 
drug, adverse effect, poisoning, intoxication, or toxicity 
in the final diagnosis of the discharge summary or the 
consultation form. Further studies may be needed to 
verify the appropriateness of our rules for detection of 
additional ADEs in other hospitals. 

While we found differences among the three report- 
ing models, they each had their limitations. A spontane- 
ous reporting program requires health professionals to 
decide which drug caused the event, describe the event, 
and determine what actions to take to correct the prob- 
lem. Health professionals are usually not well-motivated 
and may not know the significance of post-market sur- 
veillance included in a spontaneous pharmacovigilance 
program [20]. Health professionals must be educated 
on the importance of spontaneous ADE reporting. The 
CDR had several advantages compared to a spontane- 
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ous reporting system, including cost-effectiveness [15] 
and is less dependent on the education and motivation 
of health professionals. We recruited one additional 
nurse for ward rounds, but we did not recruit any ad- 
ditional employees for the CDR. However, our CDR 
program had several limitations. Because we reviewed 
the CDR data retrospectively, we were unable to obtain 
additional information by interviewing the patients or 
information providers. We monitored the final diagno- 
sis for five signals in the discharge summary and the 
consultation form, but doctors may not have described 
insignificant ADEs or may have deleted the description 
entirely [15]. Therefore, this method may also be subject 
to under-reporting. Lag time between ADE occurrence 
and registration after causality assessment was also 
inevitably significant with our CDR method, and most 
of the patients with signs were discharged at the time 
of the causality assessment. Using the ward round and 
chart review system, we could interview patients and 
obtain high-quality data, but this is costly and labor- 
intensive, and conducting ward rounds in all wards may 
not be practical [15]. Thus we included rounds in only 
30 of 68 wards, which might have caused selection bias, 
and so the data might not be representative of the gen- 
eral features of ADEs at this hospital. 

The ultimate goal of a hospital pharmacovigilance 
program is prevention of ADRs. Studies have shown 
that 19% to 61% of ADRs that occur in a hospital are 
preventable [31-33]. We registered reported ADEs to 
the EMR system if they belonged to the certain, prob- 
able, or possible classes of the WHO UMC causality- 
assessment criteria, and the referee of the Drug Adverse 
Event Monitoring Committee of our hospital judged 
that the reported ADEs were clinically significant. Then, 
if a physician prescribed a similar class of drug to that 
which resulted in a registered ADE, a pop-up window 
was generated in the EMR to remind the physician that 
the patient had experienced an ADE. Furthermore, the 
Medication Management Use Committee of our hospi- 
tal reviewed frequent elicitors of ADEs and created a 
program to prevent ADE occurrence, which included 
dropping out frequent elicitors from the available drug 
list and registering drugs that frequently elicited seri- 
ous ADEs as high-alert medications. In addition, non- 
preventable ADEs could in future become preventable 
through use of new technologies to administer hospital 
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services. 

We conclude that active surveillance programs de- 
tect more serious ADEs and ADEs related to laboratory 
abnormalities than did either of the other programs. 
Spontaneous pharmacovigilance systems are insuf- 
ficient; thus, active surveillance programs should be 
implemented in the hospital setting to ensure patient 
safety. 
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